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Abstract^  Cyclic  signal  processing  refers  to  situa¬ 
tions  where  all  the  time  indices  are  interpreted  modulo 
some  integer  L.  Since  the  frequency  domain  is  a  uni¬ 
form  discrete  grid,  there  is  more  freedom  in  theoretical 
and  design  Jispects.  The  basics  of  cyclic(L)  multirate 
systems  and  filter  banks  have  already  appeared  in  the 
literature,  and  important  differences  between  the  cyclic 
and  noncyclic  cases  are  known.  Since  there  is  a  strong 
connection  between  paraunitary  filter  banks  and  or- 
t  honor  in  al  wavelets,  some  deeper  questions  pertaining 
to  cyclic(L)  paraunitary  matrices  are  addressed  in  this 
paper.  It  is  shown  that  cyclic(L)  paraunitary  matri¬ 
ces  do  not  in  general  have  noncyclic  paraunitary  FIR 
interpolants,  though  HR  interpolants  can  always  be 
constructed.  It  is  shown,  iis  a  consecjuence,  that  cyclic 
l^araunitary  systems  cannot  in  general  be  factored  into 
degree  one  nonrecursive  paraunitary  building  blocks. 
The  connection  to  unitariness  of  the  cyclic*  state  space 
realization  is  also  addressed. 

1.  INTRODUCTION 

Cyclic  signal  processing  refers  to  situations  where  all 
the  time  indices  are  interpreted  modulo  some  integer 
T.  In  such  cases  the  frequency  domain  is  defined  as  a 
uniform  discrete  grid,  as  in  li-point  DFT  [5], [7].  This 
offers  more  freedom  in  theoretical  as  well  fis  design 
aspects.  The  circular  convolution  viewpoint  lifts  al¬ 
ready  found  applications  in  image  coding  [8], [6].  Filter 
banks  bfised  on  circular  convolution  have  also  been  in¬ 
troduced  with  various  different  motivations,  including 
the  generation  of  cyclic  wavelets  [2], [3], [4], [10].  The 
fundamentals  of  cyclic(L)  multirate  systems  and  fil¬ 
ter  banks  have  also  been  presented  recently  [10],  em¬ 
phasizing  important  differences  between  the  cyclic  and 
noncyclic  cases. 

In  view  of  the  increasing  interest  on  this  topic,  and 
since  there  is  a  strong  connection  between  paraunitary 
filter  banks  and  orthonormal  wavelets  [1],  [9], [11]  some 
theoretical  questions  pertaining  to  cyclic(L)  parauni¬ 
tary  matrices  were  fiddressed  in  [lOj.  Since  then  a  num¬ 
ber  of  deeper  properties  have  been  discovered,  which 
might  be  of  significant  interest  to  researchers  in  the 
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filter  bank  and  wavelet  communities.  The  purpose  of 
this  paper  is  to  present  some  of  the  interesting  prob¬ 
lems  that  connect  cyclic  and  noncyclic  paraunitary  sys¬ 
tems. 

2.  CYCLIC  LTI  SYSTEMS 

Consider  two  sequences  x(n)  and  h{n)  defined  for  0  < 
n  <  L  —  1,  and  let  y{n)  denote  their  circular  or  cyclic 
convolution  [7].  That  is,  y{7i)  =  -  m) 

with  all  arguments  interpreted  modulo  L.  We  can  re¬ 
gard  .7:(77.)  and  y{7i)  fiS  the  input  and  output,  respec¬ 
tively,  of  a  linear  system.  With  all  time- arguments 
interpreted  modulo- L,  this  is  also  a  time-invariant  sys¬ 
tem  (i.e.,  a  circular-shift  invariant  system).  We  say 
that  {h{7i)}  is  a  cyclic  LTI  system.  For  the  purpose 
of  interpretation  one  can  also  regard  x(n)  to  be  a 
periodic-L  input,  for  which  the  LTI  system  h{n)  yields 
the  periodic-L  output  y(n).  This  definition  also  ex¬ 
tends  to  the  multi-input  multi-output  case  where  the 
transfer  function  is  a  matrix  sequence  E(/c),  regarded 
as  the  L-point  DFT 

L-l 

E(fc)  =  ^e(n)H^^,  0<fc<L-l, 

n=0 

and  the  input-output  relation  in  the  cyclic-time  do- 
main  is  y(n)  =  Em=o®(”  “  m)x{m). 

A  cycIlc(L)  paraunitary  system  is  defined  to  be  a 
cycIic(L)  LTI  system  whose  transfer  matrix  E(/c)  is 

unitary,  that  is,  E^lc)'E{k)  =  I  for  0  <  /:  <  L-l.  Com¬ 
pare  this  with  the  paraunitary  property  of  a  noncyclic 
system  E^onC^),  which  is  defined  as  Enon(2)Enon(2)  ~ 

I.  (wheie  Ejtojt(2)  =  Enf>7i(l/2^  ))•  Similarly  the  scalar 
cyclic(L)  system  is  said  to  be  allpass  if  H{k)  =  for 
0  <  /c  <  L  -  1. 

The  noncyclic  counterpart  of  a  cyclic(L)  LTI  system 
E(fc)  is  defined  as 

L-l 

(1) 

n=0 

This  can  be  regarded  as  an  interpolated  version  in  the 
frequency  domain,  with  E(^')  representing  the  samples 
of  E„,.(z)  at  the  unit-circle  points  z  = 
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Notice  that  the  noncyclic  version  is  only  one  possi¬ 
ble  interpolant.  More  generally,  a  noncyclic  transfer 
function  is  said  to  be  an  interpolant  for  the 

cyclic(L)  system  E{k)  if 

=  E{k).  (2) 

If  the  interpolant  is  restricted  to  be  of  the  form  Ejnf(-^)  = 
and  N  <  L  -  1  (i.e.,  FIR  with  order 
<  L- 1)  then  Enc{z)  =  EintC^)  because  ei„f(n)  is  then 
the  inverse  DFT  of  E(fc)).  However,  there  can  exist  in- 
terpolants  with  AT  >  L,  and  even  HR  interpolants. 

In  [10]  we  showed  that  the  noncyclic  counterpart 
does  not  in  general  share  the  properties  of  the  cyclic 
system.  For  example,  H{k)  might  be  a  cyclic(L)  all¬ 
pass  filter  but  Hnd^)  rnay  not  be  allpass.  Similarly 
it  is  possible  that  E(fc)  is  paraunitary  but  not  Enc{z). 
This  raises  the  following  natural  question:  are  there 
FIR  paraunitary  interpolants  with  higher  orders,  and 
are  there  HR  interpolants?  In  the  next  few  sections 
we  address  various  aspects  of  these  questions,  and  also 
connect  this  interpolation  problem  to  the  question,  of 
factorizability  of  cyclic (L)  paraunitary  matrices. 

3.  PARAUNITARY  INTERPOLATION 

Given  an  arbitrary  cyclic(L)  paraunitary  system  H(/:), 
that  is,  a  sequence  of  M  x  M  unitary  matrices 


H(0),H{1),...,H(L~1),  (3) 


interpolant  Hint{z)  represents  an  allpass  filter  with  a 
pole  outside  the  unit  circle.  This  raises  the  following 
question:  suppose  we  allow  the  allpass  interpolant  to 
be  of  higher  order  N  (even  possibly  N  >  L),  That  is, 
we  now  have 


H{k)  = 


+ 

1  +  bW^ 


^Yln=0^N-n^ 


(5) 

Can  we  show  there  exists  a  pol>Tiomial  of 

some  order  N  with  all  its  zeros  inside  the  unit  circle 
(i.e.,  a  minimum-phase  polynomial)  such  that  H{k)  = 
following  example  gives  evidence  to 

the  contrary. 

Example  L  Minimum  phase  interpolants.  Let  B{k)  = 
1  +  bW^  with  6  >  1  and  let  BUz)  = 
be  an  interpolant  with  real  coefficients,  i.e,,  B{k)  = 
We  can  find  unlimited  number  of  choices 
of  N  and  {bn}  satisfying  this.  But  for  even  L,  there 
does  not  exist  even  one  choice  such  that  Binti^)  has 
minimum  phase  (i.e.,  all  zeros  in  jr]  <  1).  This  is 
proved  as  follows:  since  the  coefficients  {bn}  are  real,  a 
necessary  condition  for  Bint{z)  to  have  minimum  phase 
is  that  Bint{l)  and  Bint{—1)  have  the  same  sign  (Prob¬ 
lem  2.13,  [9]).  By  setting  k  =  0  in  B{k)  =  BintiW^^) 
we  find  B(())  =  Bint(l)>  Similarly  B{L/2)  —  Bin£(~l). 
Using  b  >  I  we  therefore  conclude 


can  we  always  find  a  paraunitary  interpolant 
This  is  the  paraunitary  interpolation  problem.  For 
the  scalar  case  {M  =  1)  this  becomes  the  allpjiss 
interpolation  problem.  For  the  matrix  c<ise  (arbi¬ 
trary  M)  we  distinguish  between  the  FIR  Ciise  where 

=  En=ph(n)s"",  and  the  HR  case.  In  the 
HR  cfise  we  again  distinguish  between  rational  inter¬ 
polants  (where  each  element  in  Hi„((.s)  is  a  ratio  of 
polynomials  in  z~^),  and  irrational  ones. 

3.1.  Scalar  Allpass  Interpolation 

Any  scalar  cyclic  allpass  filter  H{k)  can  be  written  in 
the  form  H{k)  = 

where  |c|  =  1,  This  shows  that  there  exists  a  noncyclic 
allpass  interpolant 

j  J 

Hintiz)  =  icJ2bj-n--n/iT,^nZ-n 

n=0  n—O 


where  |c|  =  1.  In  general,  this  interpolant  does  not  have 
all  poles  inside  the  unit  circle.  For  example,  suppose 
=  1  and  consider  the  cyclic  allpass  filter  H{k)  and 
its  interpolant  Hint{z)  given  below: 


H{k)  - 


1  +  bW^ 


6*  -h 


(4) 


Let  |6|  >  1.  Then  the  cyclic  allpiiss  filter  is  still  well 
defined  (because  1  -|-  bW^  ^  0  for  any  k).  But  the 


Bin£(l)  =  l  +  6>0,  B,ne(“i)-l-6<0. 


Thus  Bintil)  and  could  never  have  the  same 

sign  no  matter  how  we  choose  N  and  {bn}.  Summariz¬ 
ing,  B{k)  does  not  have  a  minimum  phase  interpolant 
Binti^).  However,  it  is  still  conceivable  that  the  ratio 

Binti^) / Binti^)  has  some  cancellations,  thereby  result¬ 
ing  in  a  stable  allp^lss  interpolant.  Moreover,  we  have 
not  considered  the  possibility  of  a  complex-coefficient 
interpolant  (which  is  conceivable  even  for  real  b). 

3.2.  FIR  Paraunitary  Interpolation 

Given  the  unitfiry  sequence  (3),  can  we  always  find  a 
paraunitary  interpolant  restricted  to  be  FIR,  i.e.,  of 
the  form  Hini(2:)  =  scalar 

case  {M  =  1)  the  answer  is  evidently  no,  because  the 
interpolant  has  to  be  an  FIR  allpass  function  (which 
cannot  be  more  general  than  a  mere  delay).  So  we 
assume  M  ^  1.  If  we  make  the  restriction  N  <  L 
the  coefficients  h(n)  are  simply  the  inverse  DFT  coef¬ 
ficients  of  Hintd^Z^)  interpolant  is  the  non¬ 

cyclic  counterpart  defined  in  Sec.  2.  This  may  not  be 
paraunitary  as  seen  from  the  examples  of  [10] .  More 
generally,  suppose  we  allow  N  to  be  arbitrarily  large 
but  finite.  Does  this  allow  us  to  always  find  a  parauni¬ 
tary  inteipolant?  In  general  the  answer  is  still  no,  as^ 
we  shall  demonstrate.  For  this  we  first  review  a  well 
known  result  for  noncyclic  2  x  2  causal  FIR  paraunitary 
matrices  [9]: 


2 


Theorem  1.  Let  Hnon(2^)  =  5Zn=o  be  a 

2x2  causal  FIR  paraunitary  system.  Then  it  has  the 
general  form 


Ho{z) 

[h,{z) 


(6) 


where  Ho{z)Hq{z)  4-  Hi{z)H\{z)  —  1  (power  comple¬ 
mentary  property),  6  is  real,  and  no  is  any  integer  large 
enough  to  ensure  causality.  ^ 

Consider  now  the  cyclic(L)  example 


H(A:)  = 


gJQ(fc) 

0 


0 

eJ/5(fc) 


(7) 


which  is  evidently  paraunitary  for  any  arbitrary  (real¬ 
valued)  a{k)  and  /?(/:).  Suppose  there  exists  a  noncyclic 
causal  FIR  paraunitary  interpolant  H,:„i(2).  If  this  in- 
terpolant  is  diagonal,  then  and  a  (A:) 

has  to  be  of  the  form  -2nkN/L  plus  a  constant.  Thus 
for  arbitrary  a(A')  and  i3{k),  there  is  no  diagonal  FIR 
paraunitary  interi^olant  Hj„i(2).  How  about  a  nondi¬ 
agonal  interpolant?  Since  it  would  have  the  form  (G), 
a(A')  and  /?(A*)  cannot  have  arbitrary  combinations  of 
values.  Only  combinations  satisfying 


/?(/c)  —  —  ck(Aj)  —  2/7 kii.{)  j Ld  8 

for  some  8  are  allowed.  This  shows  that  cyclic  paniuni- 
tary  systciiis  do  not  in  general  have  noncycUc  FIR  pa¬ 
raunitary  interpolants.  Whenever  such  an  interpolant 
does  exist,  it  can  be  factorized  into  the  form  [9] 

j 

H,„,(x)  =  H„„(l)J](l-UiU,t  +  .-‘u,:uj)  (8) 

7=  1 


where  Uj  are  unit  norm  vectors.  By  rei^lacing  with 
we  obtain 

j 

H(fc)  =  H(0)  n  (l  -  u,:uj  +  iy^-u,:uj )  (9) 

which  is  a  factorization  of  the  cyclic  paraunitary  sys¬ 
tem  H(A:)  in  terms  of  the  building  h)locks  —  UjuJ  + 

Thus,  whenever  a  noncyclic  FIR  parauni¬ 
tary  interpolant  exists,  the  cyclic  system  can  be  hic- 
tored  as  above.  Conversely,  if  the  cyclic  s3stem  can  be 
factored  as  in  (9),  then  replacing  with  z’^^  we  ob¬ 
tain  a  FIR  paraunitary  interpolant.  Summarizing  we 
have  proved: 

Theorem  2.  FIR  interpolants.  Let  H(A;)  be  a 
cyclic(L)  paraunitary  system,  (i.e.,  H(A:)  unitary  for 
0  <  fc  <  L  —  1).  Then  it  has  a  noncyclic  causal  FIR 
paraunitary  interpolant  Hintiz)  if  and  only  if  H(A')  can 
be  factorized  in  the  form  (9)  where  are  unit-norm 
vectors.  <> 


4.  HR  PARAUNITARY  INTERPOLATION 

If  we  do  not  restrict  the  interpolant  to  be  FIR,  then 
we  can  always  find  a  paraunitary  interpolant  for  the 
unitary  sequence  (3).  For  this  we  simply  define, 

UUen  =  n{k),  <  a;  <  (10) 

Lf  L 

for  0  <  ^'  <  L  -  1.  Then  the  sample  values  Hint(H^£"^) 
are  evidently  equal  to  H(A:).  The  interpolant 
is  a  piecewise  constant,  and  has  discontinuities  at  the 
frequencies  2'rk/L.  It  is  therefore  not  a  rational  func¬ 
tion  in  (i.e.,  the  elements  in  the  matrix  are  not 
ratios  of  pol^momials  in  z).  The  following  theorem  as¬ 
serts  that  we  can  always  construct  rational  solutions  in 
the  HR  case.  Stability  of  the  interpolant,  however,  is 
not  asserted. 

Theorem  3.  IIR  interpolants.  Let  H(0),  H(l), , . . 
H(L  -  1)  be  a  sequence  of  M  x  M  unitary  matrices. 
Then  there  exists  a  causal  sj^stem  with  rational  transfer 
matrix  such  that  =  H(fc).  <> 

Proof.  Tlie  crucial  building  block  is  the  matrix 

Ufc(s)=I  -  uu^  +  s“*Ffc(s)uu^ 

where  Fk{z)  is  a  rational  allpass  filter  and  u  is  a  unit- 
norm  vector.  We  can  verify  that  Ufe(2)  is  paraunitary. 
Suppose  the  allpass  filter  Fi;{z)  is  chosen  such  that 


iy-">  m  /  fc 
m  =  k 


^^'e  can  reg.'ird  Ft (2)  as  a  rational  allpass  interiJolant 
(Sec.  3.1)  with  samples  at  2  =  as  specified 

above.  W’ith  this  choice  of  Ffc(2),  the  matrix  Ufc(2), 
sampled  at  2  =  Hy"',  yields 


^  /  H,* — m  \  f  I  fni  all  T7i  ^  k 

^  ^  1 1  —  2uuT  for  m  =  k 

Now  any  M  x  M  unitary  matrix  can  be  expressed  as  a 
product  of  M  - 1  matrices  of  the  form  I  -  2uut.  More 
precisely  [9]  each  matrix  H(fc)  in  the  given  unitary  se¬ 
quence  can  be  expressed  as 


H(fc)  =  ^  n  \{k) 

where  unit-norm  vectors  and  A(A')  is  diago¬ 
nal  with  nth  diagonal  element  We  can  find  a 

rational  allpass  filter  Fn(2:)  such  that 

Then  the  diagonal  matrix  Dfc(2)  with  diagonal  ele¬ 
ments  F„(2)  has  the  unit-circle  samples 

D..(»r")  =  {V)  Zii 
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By  multiplying  matrices  of  the  form  Ufc{z)  and  0^(2), 
we  can  define  a  noncyclic  paraunitary  system  G/.(2) 
such  that 

<=*(»'-)={},(*)  Zik 


replacing  with  2”^  in  the  structure,  would  be  pa¬ 
raunitary  (because  the  converse  part  holds  in  the  non¬ 
cyclic  case  [9]).  Since  FIR  paraunitary  interpolants  do 
not  alWf'iys  exist  (Theorem  2),  the  point  is  proved. 

6.  CONCLUDING  REMARKS 


The  product  Hint(^)  =  Go(2)Gi(2) . . .  G£,_i(2)  then 
represents  a  rational  HR  paraunitary  interpolant  for 
the  given  matrbc  sequenence  {H(fc)}.  ^  ^  y 


5.  UNITARINESS  OF  REALIZATION  MATRIX 

Suppose  we  are  given  an  implementation  for  a  cyclic 
transfer  matrix  E(fc).  This  implementation  has  a  state 
space  description  of  the  form  [10]  v(n  +  1)  =  Av(n)  + 
Bx(n)  and  y(n)  =  Cv(n)  -f  Dx(n).  The  realization 
matrix  for  the  implementation  is  defined  as 


The  following  result  connects  the  cyclic-paraiinitary 
property  to  unitariness  of  the  realization  matrix. 

Leniina  1.  If  the  realization  matrix  is  unitary,  then 
the  cyclic  system  E(/c)  is  paraunitary. 

Proof,  Rewrite  the  state  eciuations  jis 

v(n-f  1)1  _  [a  B]  rv(7?,) 

y(n)  J  “  [C  dJ  [x{n) 

Unitariness  of  the  realization  matrix  implies  ||v(n  -f 
1)11^  +  lly(»0|p  =  l|v{n)||2  +  ||x(7?.)P  where  ||v||2  de¬ 
notes  vtv.  If  we  write  the  preceding  equation  for 
^  ^  ^  ^  L  —  I  and  add  them  up,  we  obtain 

L-l  L-l 

^yt(7i)y(n)  =  ^xt(7i)x(7i) 

n-0  n=0 

by  using  the  fact  that  v{n  +  L)  =  v(n).  With  X(A:)  = 
tnZo  x(n)iyi;''  and  Y(A:)  =  YluZo  VinWf  ,  we  then 
obtain  (using  Parseval’s  relation)  ^^=(1  Yt(A-)Y(A:)  = 
Efc=d  xt(A-)X(A),  that  is, 

L-l 

5^xt(A)Et(A)E(A)X(A)  =  ^X^(A-)X(fc) 

fc=0  k==0 

This  should  hold  for  all  sequences  {X(A:)},  which  im- 
plies  that  xt(fc)Et(A)E(A)X(A)  =  xt(A)X(A)  for  any 
X(A'),  proving  Et (A)E(A)  =  I  indeed.  V  V  V 

This  result  is  analogous  to  a  result  in  the  non¬ 
cyclic  case  [9].  However,  unlike  in  the  noncyclic-  ciise, 
we  do  not  have  the  converse  result.  That  is,  even 
if  E(A-)  is  paraunitary,  there  may  not  exist  a  inmi- 
77ial  iionrecursive  structure  with  unitary  system  ma¬ 
trix.  When  such  a  structure  doe-s  exist,  tlie  FIR  in¬ 
terpolant  Eini{z)  =  D  +  C{zl  -  A)“^B,  obtained  by 


It  is  well  known  that  noncyclic  FIR  paraunitary  sys¬ 
tems  can  be  factored  [9]  in  terms  of  the  building  blocks 

I  ~  Uiut  -f  2“^Uiut,  where  utu*  =  1.  But  in  the  cyclic 

case,  factorization  in  terms  of  (I  -  Uiut  -f  IF^Uiut)  is 
not  ahva}^  possible.  In  fact  Theorem  2  shows  that  such 
factorization  is  possible  if  and  only  if  there  exists  an 
FIR  paraunitary  interpolant.  However,  the  fact  that 
there  ahvaj's  exists  a  rational  HR  interpolant  (Theorem 
3)  means,  in  particular,  that  we  can  obtain  a  factor¬ 
ization  of  the  cyclic  system  H(A:)  in  terms  of  slightly 
modified  building  blocks.  These  have  the  form  Ufc(z) 
and  Dk{z)  given  in  the  proof  of  Theorem  3,  with  2 
replaced  by  everyw’here. 
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